United States Patent (i9] 

Tanioka et al. 



i 



US005760918A 
[11] Patent Number: 
[45] Date of Patent: 



5,760,918 
Jun. 2, 1998 



[54] IMAGE PROCESSING APPARATUS WITH 
CONVERSION AND RECONVERSION OF 
THE NUMBER OF BITS PER PIXEL 

[75] Inventors: Hlroshi Iknioka; Yasahiro Yamada, 
both of Yokohama. Japan 

[73] Assignee: Canon Kabushild Kaisha. Tokyo, 
J^>an 

[21] AppL No.:- 183,780 
[22] Filed: Jan. 21, 1994 

Related U^. Application Data 

[63] Contmuatian of Scr. No. 5«7,858, Sep. 25, 1990. 

PO] Foreign Application Priority Data 

Sep, 27, 1989 (JPl J^an 1-249202 

Dec. 22, 1989 [JP] Japan 1-331253 

[51] InL CL* „ H04N V40 

[52] U.S. CI 358/445; 358/448; 358/455; 

358/456; 382/252; 382/272 

[58] Fldd of Seardi 358/443. 445, 

358/455, 456. 457, 458, 447, 448, 465, 
466; 382/54. 52, 50, 251. 252. 270, 272 



[56] References Cited 

U.S. PATENT DOCUMENTS 

4,876,610 1W1989 Ohsawa ct al „ 382/54 

4,931,881 6^1990 Matsui et al 358/464 

5.027,221 6^1991 Hisatake et al 358/401 

5.121.446 6^1992 Yamada et al 382/52 

5.121.447 6/1992 Tanioka el al 358/466 

5453,925 1W1992 Tanioka et al 358/466 

Primary Eozmmer— Thomas D. Lcc 

Attorney, Agent, or /^/rm-4^itzpatrick. Cella, Harper & 

Scinto 

[57] ABSTRACT 

In an image processing apparatus in which digital data of a 
certain number (m) of levels are converted into digital data 
of a larger number (n) of levels, then subjected to certain 
desired editing processing, and again digitized to data of the 
original number (m) of levels. The redigitization to m levels 
is conducted by determining the average density of a pre- 
determined area, utilizing data of pixels already redigitized 
to m levels, and redigitizing ttie data of n levels into m 
levels, utilizing the average value. This process significantly 
reduces the amount of data processing required without 
formation of an unpleasant texture on the image resulting 
from errors in digitization. 

14 Claims, 10 Drawing Sheets 
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FIG. 2A 
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IMAGE PROCESSING APPARATUS WITH 
CONVERSION AND RECONVERSION OF 
THE NUMBER OF BITS PER PIXEL 

This £^)plication is a coDtinuation of application Ser. No. 
07/587,858, filed Sep. 25, 1990. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to an image processing 
^aratus such as a digital copying machine^ or facsimile 
apparatus or the like, and more particularly to an image 
processing af^)aratus for estimating a gradation image £rom 
image data already digitized into a binary or multi-level 
state, and the redigitizing, after a predetermined process, 
said image data to binaiy or multi-level data. 

2. Related Background Art 

For gradation processing of input multi-level image data 
into multi-level or binary data of a number of bits per pixel 
less than that of said input data, there are already known the 
so-called independently determined dither mediod and the 
conditionally detennined dither mediod. 

Also, for effecting a filter processing such as expansion, 
reduction or rotation, on that binary digitized image. Japa- 
nese Unexamined Patent Publication (Kokai) No.58-25767 
discloses a method of infeiring a gradation image from an 
image binarized using the independently d^ermined dither 
method flying a process to said gradation image and 
again binary-digitizing said gradation image. 

Also, there is known, as disclosed in J^>anese Unexam- 
ined Patent Publication (Kokai) No. 62-281673. a method of 
determining a weighted average on an image binary digi- 
tized using the eiror dispersion method, which is a condi- 
tionally determined dither method, infeiring an appropriate 
multi-level value f<x said average, applying a desired pro- 
cessing thereto, and again binary-digitizing said image using 
the error dispersion method. 

However, though such conventional methods are effective 
for a binaiy image digitized by eitiier dither method, they 
require a large amount of data processing so that the 
processing speed is inevitably slow and the apparatus 
becomes expensive. 

Particulary. the binary digitization by error dispersion 
employed in the latter method requires an especially laige 
amount of data processing and cannot be realized in a 
high-speed or inexpensive a{q>aratus. 

Besides, as the error dispersion method distributes the 
error which occurs in the binary digitization to the image 
data of many pixels in the vicinity, the image inevitably 
beccHues unshaip if image conversion b^een binaiy and 
multi-level (multi-bit) coding is repeated. 

There is also known a multi-level pseudo-gradation pro- 
cessing m^od, in which input image data of 8-bit density 
levels (0-255) are digitized by a dither method into dend^ 
levels of about 16 levels (4 bits) and intermediate densities 
are reproduced by controlling the number of recording dots 
and density levels ttiereof in a unit area. Such method is 
advantageous fcr transmissioD and storage of image data, 
since a recorded image with quality similar to that of tiie 
original image can be rc^Hoduced with a reccing apparatus 
of a limited number of density levels and with a limited 
amount of data. 

However, image editing after said pseudo-gradation pro- 
cessing is practically impossible, because image expansion 
or reduction by simple skipping or interpolation of thus- 
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processed data results in the formation of extremely unpleas- 
ant textures on the image. 

SUMMARY OF THE INVENTION 

^ An object of the present invention is to eliminate the 
above-explained drawbacks of the prior tcchn(^ogies and to 
provide an image processing apparatus capable of convert- 
ing data, digitized into m levels (m^2). into data of n levels 
(n^m). and ledigitizing said data of n levels, using simple 
hardware, into data of ra levels with excellent tonal rendition 
and resolution. 

Another object of the present invention is to provide an 
image processing apparams cqxable of converting a binary 
image into a multi-level image, flying a desired image 
processing in this state, and converting said multi-level 
image again into a binary image with excellent tonal rendi- 
tion and resolution with high speed and in a simple nianner. 

The foregoing objects can be attained, according to an 
20 embodiment of the present invention, by an image process- 
ing apparatus comprising: 

converter means for receiving data digitized with m levels 
(m^2) and converting said data into data of n levels (n>m); 
and 

redigitizing means for digitizing the data of n levels, 
converted by said converter means, again into data of m 
levels. 

wherein said digitizing means is adapted to determine the 
average in a predetermined area utilizing data already redigi- 
^ tized to m levels, and to digitize the data of n levels, 
produced by said converter means, into data of m levels 
based on said average. 
According to another embodiment of the present 
33 invention, there is provided an image processing apparams 
comprising: 

first calculation means for determining a weighted aver- 
age for each pixel from plural binary images in the vicinity 
of a conten^}lated pixel and the weights of a predeteimined 
40 distribution; 

input means for applying a predetermined image process- 
ing to a gradation image consisting of the weighted average 
obtained by said first calculation means and entering the data 
of the contemplated pixel of said gradation image; 

second calculation means for determining the average 
density of a predetermined area utilizing the tnnarized data; 

binarizing nteans for rebinarizing &e data of said con- 
templated pixel, based on the avdrage density obtained by 
said second calcidation means; and 

50 

ccHtection means for con^)ensating for the error generated 
in the rebinarization of the data of said contemplated pixel 
by said binarizing means. 

Still another object of the present invention is to provide 
an image processing apparatus enable of minimizing the 
deterioration in image quality even when conversions from 
a binary image to a nuilti-level image and from a multi-level 
image to a binary Image are repeated. 

Still another object of &e present invention is to provide 
60 an image processing apparatus capable of r^oducing the 
original image from image data obtained by multi-level 
pseudo-gradation processing. 

Still another object of the present invention is to provide 
an image processing apparatus capable of editing operations 
65 such as image size variation on the data obtained by pseudo- 
gradation processing, without formation of unpleasant tex- 
tures on the image. 
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The foregoing and still other objects, features and advan- FIG. IC shows multi-level data (in a range from 0 to 1), 

tagcs of ttie present invention, will become fully apparent in the vicinity of the object pixel, restored according to the 

from the following detailed description of the (deferred process of the present embodiment wherein the multi-level 

embodiments which is to be taken in conjunction with the datum f(i, j) is obtained frcHn the entered binary datum I(i, 

attached drawings. 5 j) according to the following equation: 

BRIEF DESCRIPTION OF THE DRAWINGS 2 1 m) 

Auf)^;^ ^C(x,y) J(i'X,J~y) 

FIG. 1 A is a view of bmary densities of plural pixels in an * ^ 

input image in a first embodiment of the present invention; ^^g^^^.^ ^^^^ ^ preferably has 

FIG. IB IS a view of a weighting mask for plural pixels larger values in positions closer to the object pixel position, 

in said first embodmient of the present invention; m.. * — 1 • .i> • . 

^ The area of said waghting mask ts not limited to 8 pixels 

FIG. IC is a view of multi-level data in the vicinity of the shown in HG. IB, but is preferably free from particular 

contemplated pixel, rqiroduoed in said first embodiment; directionality in perpendicular two or four directions starting 

FIG. 2A is a view of multi-level data of plural pixels in 15 from the object pixel position, 

said first embodiment of the present invention; in the foUowing there will be e3q5laincd the principle of 

FIG. 2B is a view of binaiized images in plural pixels in binary digitizing in case the restored multi-levd data f<i. j) 

said first embodiment; are subjected to a process such as image size modification g£ 

FIG. 2C is a view of a weighting mask for plural pixels filtering and then to binary redigitization. 

in said first embodiment; 20 2A, f(i. j) indicates multi-level density data, in a 

FIGS. 3A and 3B are charts showing (he principle of the normalized range from 0 to 1, at the object pixel position to 

binarizing process in said first embodiment; ^ binary digitized. Pixels above the broken line have 

no. 4 is a block diagram of an image processing appa- ^^^^ rebinarized. and, after the relanarization of the 

ratus constituting said first embodiment; ^^i^^ P^^^* P^^^® ^ conducted in succes- 

trrr^ js ■ wi i j* u • j * i * 5^°" i° o^dcT of pixels f(i. j+1), f(i, j+2), . . . 

FIG. 5 IS a block diagram showmg the details of a ^„ ^ . . 

hinary/multi-level conversion unit in the first embodiment; . ™- 2B shows the bma^ data wherein B(i j) 

' ^ . . 1. . . , . . indicates the density (**0 or "1") of the object pixel after 

FIG. 6 IS anew showmg an example of a weightmg mask rebinarization. The broken-lined frame indicates pixel dau 

employed in the bmaiy/multi-level conversion umt; j,ave already been rebinarized at the time of rebina- 

FIG. 7 is a block diagram showing the detaUs of a rization of the object pixel and are utilized in said reWna- 

Mnarization circuit employed in the first embodiment; rization of the object pixel. 

HGS. 8A and 8B are views showing examples of weight- FIG. 2C shows an example of weighting mask R for 

ing masks employed in the binarization circuit of FIG. 7; determining the average density, con^xjsed of a 3x3 matrix, 

FIG. 9 is a block diagram of an image processing appa- 33 wherein the weights foi unbinarized pixels are R(0. 0)=R(0. 

ratus constituting a second embodiment of the present -1)=0. 

invention; la the present embodiment, the weighted average density 

FIG. 10 is a view showing weighting coefScients m(Lj)of the binary images in the vicinity of the object pixd 

employed in said second embodiment; is detennined by: 

FIG. 11 is a block diagram showing the structure of a ^ 

multi-level pseudo-gradation processing unit employed in in(iy')= i z R(x,y)' B{i-x,j~y) 

said second embodiment; and x=Cy=i 

no. 12 is a block diagram showing the structure of an The object pixel f(i. j) is binarizcd according to the 

inference restoration process unit employed in said second following equations (2). utilizing said average density m(i, 

embodiment. j) already assigned binarizing correction value B^h j): 
DETAILED DESCRIPTION OF THE 

PREFERRED EMBODIMENTS bo. j>i ifM ME(i, yWi. £(; > me^, jy^K f) 

Now the f^esent invention will be explained in detail by B(i jyo if/; D^miK J) £(4 jyMi » 
reference to the preferred embodiments thereof, shown in 
the attached drawings. 

[1st Embodiment] 

At first the prindple of an «nbodiinent of the present „ ^GS^^ a»f 3B muslr|ae graphicaUy the equations C2). 

inveotioi. wiU be explained with reference to FIGS lA to " 't'P^^^J^ ^^^-^l' J) " the bmanzauon 

IQ * P*^^ J~^) tinmcdiatcly preceding the object pixel (i, 

„^ , , , ^. ^ . j)» frc>m the multi-level density f(i, j-1) into the binary 

FIG, lA shows bmary data m plural pixels of an mput j.^^ difference between the mulU- 

level density f(i, j-1) and the average density m(i, j-1) in the 

I(i, j) indicates binary data, normalized at "0" or "r, of vicinity, 

an input pixel to be converted to nmlti-level data, at the Thus, the density of the input image can be complrtcly 

object pixel position. In the pixels above the broken line, the conserved, in average, in the image after binarizaUon, by 

data input is afready complied, and binary data are tempo- binarization of a value obtained by adding said binariz^on 

rarily storedfor use in the data processing of the object pUel error E(i, j) to the density f(L j) of the object pixel. 

FIG. IB shows a weighting mask C for determining the 65 Such a process taking the binarizing error into consider- 

average density, conq>osed of a 3x3 matrix, wherein the ation allows significantly in^irovement in the ability for 

weight for a binary jrixel to be entered next is C(0, -l>=0. reproducing the tonal rendition. 



however 

Bii ^=1 if />f£tt y>w(4 ;>1. (2) 
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Id equations (2), E(i, is the error distributed to the CCD and a driving device therefor, or decodes an encoded 

density f(i. of a pixel (i, j+1) immediately succeeding binary image such as facsimile signal to release a binary 

the object pixel (i, j). image signal. The binary data released from said input 

The binarizing process of the present embodiment has an sensor unit A are supplied in succession to a binary/multi- 
image rqsrodudng ability equivalent to or superior to that of s level conversion unit B, which restores each pixel into 6-bit 
the error dispersion method despite the extremely reduced multi-level digital data* thereby providing a multi-level 
amount of data processing as explained above. This is image with 64 levels. 

because, though the above-mentioned error is compensated The restored multi-level data are sent to an editing process 

for only in an adjacent pixel, there is obtained an effect unit C and are subjected therein to a known data editing 

equivalent to the d^tribution of the error to plural pixels by lo process, such as image size conversion (for example from an 

determining the average density from plinral rebinarized A3-sized input image into A4 size), pixel density conversion 

data. between facsimile G4 and G3 fonnats. edge enhancement or 

In die present embodiment the error E(i. j+1) in the smoothing. After such editing, the multi-level data are 

binarization of the next pixel is defined as: supplied to a binarization circuit D for pseudo-gradation 

IS processing featuring the present embodiment and dien are 

EiK My=o if j>E(K jyMu jyxx O) converted into a visible image by a binaiy printer E repre- 
sented by a laser beam printer, an ink jet printer cr a thermal 

wherein a is a constant recording apparams. 

otherwise: ^ desired, a muM-lcvel printer H may be cnq>loyed for 

20 direction recording on the multi-level data supplied from the 
binary/multi-level conversion unit B or from the editing 

Eii, MMi. J>m 7>«(i J) (4) process unit C as shown in HG. 4. 

Thus, in the comparison of the average density m and the In such case, a correction circuit G is provided for digital 

density of the object pixel at the binarization^ if the density correction processing such as ccMrcction for unevenncss in 

of die object pixel is within a p-edetermined range close to 2S the CCD sensor in the input sensor unit A and/or shading 

the average density m (if the error between the average correction for the unevenness in the illuminating light 

density m and the density of the object pixel is within a source. 

p-edetermined range) as shown in equations (3) and (4). the FIG. 5 is a block diagram showing the details of the 

difference between said average density and the object pixel binary/multi-level conversion unit B shown in FIG. 4. 

density is distributed as die correction value in the rebina- 30 In FIG. 5, there are shown delay RAMs 1, 2 each for 

lization of the next pixel. storing input binary data of a line; D-flip-flops (DF/F) 3-7 

On the other hand, if the object pixel density is outside for delaying said binary data by a pixel; and an average 

said range, namely if the error between the object pixel density calculating ROM 8 for calculating die average 

density and die average density is sufficiendy large, said density of a predetermined area from the binary data in the 

cc^ection value is selected as **0'*. and conecdon is not 35 vicinity of the object pixel and restoring the datum of the 

conducted at the rel»narization of the next pixel. object pixel as a multi-level data f(i, j). 

Stated differendy, the error correction is made only when When the datum I(i, j) of the object pixel is entered, the 

the image is identified to have a gradation, from a relatively above-explained circuit provides binary data conesponding 

small density change in die vicinity of the object pixel. In to 1(1 j-1) in FIG. lA, at the output terminal of die DF/F 7. 

such case the difference from the average density, resulting 40 Also in response to the entry of die datum of said object 

from rebinarization, is cotrected in the next pixel whereby pixel a binary datum I(i-1, j+1), delayed by one line, is 

a smooth density change of the image can be faithfully released at the output terminal of the delay RAM 2 which 

processed in a pseudo-gradation processing. In this manner delays the binary data by about a line. The obtained data are 

tonal rendition of die image can be improved. supplied to die RAM 1, wherry a binary datum I(i-2, j+1). 

On the other hand, the error correction is not conducted 45 delayed by two lines by means of two RAM's 2. 1, is 

when the density of die object pixel is identified to show a supplied to the average density calculating ROM 8. 

npd change from die image density in the vidnity, as in an Also said average density calculating ROM 8 receives 

edge portion of a character or a line. In such case the I(i-2,j) from the DF/F 3, 1(1-2, j-1) from the DF/F 4. 1(i-1. 

correction value is made *'0*', whereby the rebinarization is j) fix)m the DF/F 5, 1(i-1, j-1) from the DF/F 6, and 1(1 j-1) 

conducted without loss in the resolving power resulting frx)m 50 from die DF/F 7. 

the density conservation. In this manner the resolving power When all the binary data are supplied to the input termi- 

can be improved in such edge portion. nals of the ROM 8, the results of the above-e:q)lained 

According to die process featuring the present invention, calculations of equation (0) can be easily read from a table 

in 8 gradation image area identified from the above- in said ROM 8. 

explained change in image density, the image density is 55 FIG. 6 shows an example of the weighting mask, whic^ 

conserved in the rebinarized image, utilizing the error in the is to determine the average value from the binary data of the 

rebinarization process. On the other hand, in a non-gradation object pixel and of 7 pixels in the vicinity of the object pixel, 

image area requiring a high resolving power such as In order to normalize to the 6-bit density levels (0-63) of 

characters, the image is not ccmcted fox die error in the actually entered image data, the values (obtained by 

binarization but is made close to the average density hl in <o equation (0)) of die wei^iting mask shown in FIG. 6 are 

order to prevent loss in image sharpness resulting from such multiplied by 63 and stored as 6-bit values in the average 

density conservation. density calculating ROM table. 

FIG. 4 is a block diagram of an image processing ap^ FIG. 7 is a detailed block diagram of the binarization 

ratus of die present invention, utilizing the process featuring circuit D shown in RG. 4. 

the above-explained embodiment. 65 In FIG. 7 there are shown delay RAMs 31, 52 each for 

In FIG. 4, an input sensor unit A binarizes a read image delaying binarized data for a line; D-fiip-flops (DF/F) 33-37 

by means of a photoelectric converting device such as a for delaying the fainaiy data by a pixel; an average density 
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calculatiDg ROM 38 for calcukting the average density of a Also the mask shown in FIG. 8B is to detennine the 

predetennined area from the binary data in the vicinity of the average from binary data of 12 pixels in the vidnity. In the 

object pixel and releasing the obtained average density as present embodiment, in order to normalize to the 6-bit 

tfie threshold value for binarizing the datum of the object density levels (0-63) of the actually entered image data, the 

pixel: a comparator 10 for con^)aring the multi-level datum 5 values (obtained by the equation (0)) of the weighting table 

•!?'loirU*^'^r.^«^ fl*" '"^Tf ^ ™* are multipled 63 times and are stored in 
said ROM 58; a D-flip-flop (DF^ 11 for delaying Ae ^he form of 60 hit values in ttie average density calculating 

mulU-level data from an adder 12 for a clock cycle penod; j^qj^ ^ j s 

an adder 12 for adding either of the enror data released from * ^ * ■ *u * 

a subtracter 9 or selected by a selector 14, to a 6-b«t ^^^^ ^T^^^^* f 
multi-level datum suppUed from the correction circuit; a ^° ^nibodunent aUows to reduce the amount of data processm 

con^>arator 13 for comparing the difference between the companson with that of the average density aH)roxiina- 

multi-level datum of the object pixel from the subtracter 9 mediod, smcc the binariration of the input multi-level 

and the threshold value with a predetermined value a; and conducted with a threshold value whidi is the average 
a selector 14 for selecting either the output of the subtracter density calculated only from afready rebinarized data. In 

9 or a signal "0" acccarding 10 a selection signal from said addition the tonal rendition can be significantly improved 

comparator 13. since the correction for the error between the input multi- 

In the above-explained circuit the comparator 10 releases ^^^^ ^« average density, generated at tfie bina- 

a 1-bit datum B(i, j) rebinarized according to equations (2). nzation of the input nmlti-level data, is corrected only when 

Said binarized datum is supplied to the RAM 32 for the within a predetermined range, 

delay of a line. A binary datum B(i-1, j+1) delayed by one ^ Besides, as said error between the average density and the 

line in the RAM 32 is supplied to the RAM 31, and a binary ^°P"* multi-level damm is not corrected if said eiror exceeds 

datum B(i-2, j+1) delayed by two lines in the RAM*s 32, 31 predetermined range, it is rendered possible to prevent 

is supplied to the average density calculating ROM 38. ^^^^ *^ resolving power resulting from tfie cwiservation of 

Said ROM 38 also receives dattun B(i-2. j) from the DF/F "^8^ density, and to rqjroduce edge portions in the image 

33, B(i-2, j-1) from the t>F/F 34. B(i-1. j) from the DF/F ^5 clearly. 

35, B(i-1, j-1) from the DF/F 36 and B (i, j-1) from the ^ ^« present embodiment the binarizing error E is 

DF/F 37. distributed only to the next pixel, but the present invention 

The above-mentioned binary data are binary images of the limited to such embodiment For example, the ability 

pixels in the vicinity of the input image f(i, j) as shown in reproducing tonal rendition can be improved even with 

FIG. 2. The average density calculating ROM 38 stores ^ a small weighting mask, by distributing the erro- E to plural 

results of the equations (1) and (2) for determining the pixels in the main scanning direction, such as 3E(i, j+1 )/4 to 

threshold value m(i. j). and can therefore "calculate" said P^^^l (i. j+1) and E(i, j+iy4 to pixel (i, j+2). 

threshold value at a high speed by entering said binary data ^ ^ possible to distribute said aror E to plural pixels 

to the input addresses of the ROM 38. ^^^^h are two-dimensionally displaced from the object pixel 

The obtained threshold value is supplied to the subtracter l^'csent in die vicinity with predetermined distribution 

9 and the comparator 10. factors, as in the error dispersion method. 

Said subtracter 9 and the comparatCH- 10 receive f(i,j>hE(i, Such method somewhat complicates the hardware 

j) from the DF/F 11. structure, but improves the rqxroducibility of image, since a 

From these input signals, the subtracter calculates die uniform images can be obtained not only in the main 

difference of right- and left-hand terms in the relation (2) as ^ scanning direction but also in the sub-scanning direction, 

follows: The values of the fOTegoing weighting masks become 

larger in the pixels closer to the object pixel position, but the 
distribution of said values is not limited. It is also possible 

E(i. M>=^i J>^i. jyMK f) (5) y^jj^ pj^gj^ ^y^^^ direcdy adjoining to the object 

On the other hand, the comparator 10 compares f(ij)+E(i. as pixels, 

j) with m(i. j) and releases binary datum B(i, j). The binary/multi-level conversion process explained 

The error E(i, }f 1), obtained in the subtracter 9 according above can satisfactorily restore the multi-level image from 

to the equation (5). is supplied to the selector 14 and the any image binarized by the minimum average eiror method, 

comparator 13. error dispersion method. Bayer* s dither method or above- 

The comparator 13 compares said error E(i, j+1) with the 50 explained binarizing method of the present embodiment lo 

constant a according to equation (3), and, based on die result addition, said binary/multi-level conversion method is not 

of said conq>arison, sends a selection signal to the selector limited to the foregoing embodiment but is subject to 

14. various modifications. 

In response to said selection signal from the comparator For example, in the case of a binary image which is 

13, the selector 14 releases either E(i, j+l)=0 if the absolute 55 binarized by a so-called dot fattening dither method in whi€^ 

value of said error E(l j+1) is larger than a, or the output of each dot is composed of 64 or 32 pixels, tticre is preferably 

the subtracter 9 without change, ff said absolute value of the employed a weighting mask larger than that shown in FIG. 

eiTor E(i, j+1) is equal to or smaller than a. 6, such as a mask of 4x4 pixels ot 6x6 pixels, in order to 

Said error E(i. j+l) is added, by the adder 12. to the input eliminate low-frequency periodicity of dots concentrated at 
image datum f(i, /fl), and the DF/F 11 delays the obtained 60 the input of binaiy image, paiticulariy in low- or high- 
sum by a clock cycle period. density image areas. If it is known that a particular input 

The binarizing operation is conducted in succession, by image was obtained by such dither method, (he weighting 

the repetition of the above-explained process. mask is preferably switched to a larger one in such case. 

FIGS. 8A and 8B show examples of the weighting mask. The "calculations** based on the wd^ting mask in the 

The mask shown in FIG. 8A is to determine die average 65 present embodiment are conducted by a LUT in a ROM, but 

from binary data of 7 pixels in the vicinity of the object said calculations can naturally be achieved with plural 

pixel. adders because said calculations only involve multiplica- 
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tions aod summations of l-bit data and constants. pseudo-halftone processing and the predicted datum n 
Ftmhermore. said calculations may also be achieved with an (=0-15) of said object pixel to be subjected to pseudo 
integrated circuit such as a gate array, in order to reduce the halftone processing, by the weighting coefficients shown in 
cost of the apparatus. FIG. 9 and adding the obtained products: 

The foregoing embodiment deals with only one kind of s 
input data, but the present invention is applicable also to a 

color image by employing input data of three (R, G and B) "^(^ ;>ixB(i-i. y-l>+4>cB(4 j~l}¥ixB(i+u j-i)^xB(i-u y>7W 

colors 

As explained lo the foregoing, the flist embodiment of the " « » ^"^"^ in a range from 0 to 15 predictable as 

present inventioD allows tempcrary restwation of a multi- lo ^bj'' ^ . . . - . ^ ^ 

level image from binary image with a simple hardware, "^^.^ co^anson of the corrected data f (i j) 

appUcation of desired image processing to the multi-level ^ ^ ^^Pl^^^. ^ of 

image, and then reconversion of the edited image into a obje<t pad datum 

binary image with exceUent tonal rendition and resolving ^^^^^J (J)" **=y*= detenmned a multi-level value n 

power with simple hardware. 15 ^^^^"^S ^^'^^^'^S 

In addition the binarizing method of said embodiment is 
capable of minimizing the loss in image sharpness even _ . 

when the conversion between bmary image and multi-level 

image and the image editing are repeated, since the error and the conversion to 16 levels is conducted, based on said 
generated in the binarization is distributed only to the next 20 n, ra„(i, j) and m„_i(L j). in the following manner: 
pixel. 

12nd Embodiment] B(k j>n if /a Jp^m^.a, y^m. (4 /)} 

In the following will be explained a second embodiment 
of the present invention, in which image data, digitized to n ^ 
levels (n^3; less than that of the iiq>ut image data), are ^ achieved multi-level digiti- 

convcrted to m levels (m>n), the same as that of the input ^^^^ ^y a multi-level pseudo-halftone process. In the 
image data, then subjected to an editing jffooess such as foUowing there wiU be explained ttie error E in multi-level 
image size modification, and again redigitizcd to n levels. digitization. Said error E is defined as foUows: 

In Ac following there will be ex{dained a case where n=4 ^ 
and mF=8. 

FIG. 9 shows an image signal fHocessing system of an » if »=«. « 

image processing apparatus constituting the second embodi- 
ment 



fy-^iii* /) if B(i, »=n-l (4) 

A multi-level pseudo-halftone process unit 100 com- ^nd is distributed to the input image data of two adjacent 

presses 8-bit image signal to 16 levels (4 bits). The obtained ^^j^^i^ following manner: 
4-bit signal can be, either in this form or after furdicr data 
compression in an encoding unit 200, stored in a memory 

unit 500 C€ transmitted by a transmission unit 400 to an ^ /(ffi,;>-^t::i,»f£2 
external equipment On the other hand, said 4-bit signal may 

be used in a recording unit 500 capable of recording with 1 6 fii /^-i /^ly^E/i (5) 
levels, such as a laser beam pdnter, for (Staining a hard cc3py 

image of quality comparable to that of the original 8-bit Consequently the corrected object pixel data f (L j) men- 

signaL Furthermore, it may be displayed with high quality in tioned above contains two error correcting components 

a display unit 600 conq>osed for example of a cathode ray generated in the multi-level pseudo-halftone processing of 

two pixels orthogonally adjacent to the input datum f(i, j). 

The transmitted or stored data are decoded in a decoding conversion from the 8-bU input signal f(i, j) into the 

unit 700, and restored as an 8-bit image signal substantiaUy signal B(i, j) can be achieved in this manner, 

identical with the original image signal, in an inference vj " * detailed block diagram of the multi-level 

rcsto-ation process unit 800. Said 8-bit restored signal is pseudo-halftone processing unit 100. wherein a line mcm<Hy 

subjected, in an editing cffoccss unit 900, to an image editing ^nd D-flip^flops (DF/F) 102, 103, 106, of 4-bit width, 

process, such as density conversion between 400 dpi and 16 respe<^vcly delay the multi-level digitized data by a line and 

pel, or an image size reduction from A3 size to B4 size. « I^el whereby the multipUcations of weighting cocffi- 

Thereafter the signal is again converted to 16 levels in a ,3 «^ents shown in FIG. 9 on 4 pixels can be conducted 

pseudo-halftone process unit 100 for display <x recording. simultaneously. Outputs of 1-bit 4-times multipUers 104, 

In the following there wiU be given more detaUed expla- J?!' *^ ^"^.T^ ^^i^"^ ""T' ^^f 

nation on tiie multi-levd pseudcThalftone process unit 100 }^^^ added m an adder 107 to obtam a value coirespond- 
and the inference restoration process unit 800, which prin- "^^ ^ "^^''.^^ m equation (1), 
dpally feature the present invention. «, ^ ^ respresented as: 

In the following descr^)tion there will be considered 8-bit 
input pixel data f(i, j) (0-255) and 4-lat multi-level data B(i g., ^y^, /uw7w„-iu 

j) (C^15) obtained by a pseudo-halftone process. A weighted "^^'^ if /(w>«H^t ^T«^n i)} 

average m„(i, J) (0-255) can be obtained from the foUowing B(i, ^=it-i if /(t />Smc/i >W«+7(n-i)> (s-) 

equation, by multiplying the data of five pixels, including 65 

those of four pixels adjacent to the contemplated object pixel the multi-level digitization Into 16 levels can be conducted, 
position of the input image data and already subjected to a based on f (1, j) and mJiL j). in the following manner 
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B(i y>l if 21fe2{/Xi, JWO')}>7 
B(i, »=14 if 203S2{/'(4 />fno(i »}>189 

Fa/>l3if2{f(i.y)-fnoa/)}>203. (6) ^ 

The signal mo(i. j) is supplied to a multi-level digitization 
circuit 108 composed of plural coiqparatoars and adders. Said 
circuit 108 also receives the couected image data f (i. j) to 
be explained later, and the multi-level digitized data lo 
obtained according to equations (2). (3). or conq>arisoDS (6) 
are supplied to the line memory 101 and the DF/F 106, 

At the same time, said circuit 108 sends a divided error 
according to equation (4). to an error memory 109 and 
an error correcting adder 110. Said adder 110 receives, from i5 
die error memory 109. also the error generated at the 
multi-level digitization of the pixel preceding by a line, and 
adds these error correcting con^nents to the pixel data, 
thereby completing the error correction. The above- 
explained operations are repeated for each pixel. The multi- 20 
level digitization circuit 108 may also be con^sed of a 
look-up table in a ROM. 

In the following there will be explained the inferred 
reslOTation of the 4-bit multi-level data, obtained by the 
multi-level pseudo-halftone process, into 8-bit signal. Hie 2S 
above-mentioned multi-level pseudo-halftone process 
merdy consists of rq)lacing the iiq>ut pixel data with a 
weighted average of adjoining five pixels. Consequently an 
average r(i, j), very close to the original f(i, j), can be 
obtained with the same weighting coefficients as shown in 30 
FIG. 9. in the following manner 

f(i, ;>lx^t-l.>-l>+4xB(i /-l)+lxff(»+l,/-lH4xB(M.>H7x 
BiuJhMJ) 

35 

Restoration to a state very close to the original signal f(i, j) 
is thus possible. 

FIG. 11 is a detailed block diagram of the inferred 
restoration unit 800. 

4-bLt multi-level data are stored for one line and for one 40 
pixel respectively in a line memory 801 and DF/F's 802, 
803. 804. then multq)lied in multipliers 805. 806. 807 by 
weighting coefficients shown in FIG. 9 and are added in an 
adder 808. Since the total sum of the wei^ting coefficients 
is 17, the obtained result naturally becomes 255 when all the 45 
multi-level data are 15. 

Though the present embodiment employs multi-level 
digitizatioQ to 4 bits, it can be likewise ^Ued to 8 levels 
with 3 bits, and the present invention is not limited to gray 
particular nimibers of levels (values of n and m). so 

Also, the values of the weighting coefficients and the 
number of weighted pixels are not limited to those in the 
foregoing embodiment Furthermore, the weighting coeffi- 
cients at multi-level digitization are preferably the same as 
those in the inferred restoration, but the process of the 55 
present embodiment is satisfactorily realizable even when 
said coefficients are nuitually different. 

As explained in the foregoing, the second embodiment 
can provide an image processing apparatus for effecting 
multi-level pseudo-halftone process enable of image res- 60 
tCKation faithful to ^e original image. 

Also there can be provided an image processing apparatus 
capable of restoring the image data, subjected to the above- 
mentioned multi-level pseudo-halftone process, to the origi- 
nal image. 65 

Fuithermore there can be provided an image processing 
apparatus capable of image editing is jrocess, such as image 
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size variation, on the data subjected to the multi-level 
pseudo-halftone process, without formation of unpleasant 
texture on the image. 

Though the {present invention has been explained by 
reference to the prefecred embodiments thereof, it is not 
limited to such embodiments and is subject to various 
modifications or variations within the scope and spirit of the 
upended claims. 

I daim: 

1. An. image processing apparatus comprising: 
converter means for receiving data digitized with m levels 

(m^2) and converting said data into data of n levels 
(n>m); 

data processing means for executing data ^ocessing on 
the data of n levels produced by said converter means; 
and 

digitizing means for digitizing the dau of n levels, data- 
processed by said data processing means, again into 
redigitized data of m levels. 

wherein said digitizing means is adapted to determine an 
average of a predetainined area, utilizing data already 
redigitized to m levels, and to convert the data of n 
levels, produced by said data processing means, into 
the redigitized data of m levels based on said average. 

2. An apparatus according to claim 1. wherein said 
conveiter means is adapted to receive binary data subjected 
to binaiy digitization, and to convert said binary data into 
multi-level data, utilizing a weighting mask having a 
weighted distribution. 

3. An apparatus according to claim 2, wherein said 
digitizing means is adapted to binary-digitize the multi-level 
data produced by said data processing means. 

4. An apparatus according to claim 3, wherein said 
digitizing means is ad^ted to determine the average density 
in a predetennined area, based on plural binary data already 
subjected to binary digitization, and to binary-digitize the 
multi-level data produced by said data processing means, 
utilizing said average density as a threshold value. 

5. An apparatus according to claim 3, wherein said data 
processing means is adapted to apply a predetennined 
editing process to the multi-level data obtained by said 
converter means, and said digitizing means is adapted to 
binary-digitize the multi-level data which has been subjected 
to said editing process by said data processing means. 

6. An apparatus according to claim 1, further comprising 
correction means for compensating for error generated in die 
digitization of the data of n levels into the data of m levels 
by said digitizing means. 

7. An apparatus according to claim 6, wherein said 
ccHrection means is adapted to conipensate for said error 
only when said error is larger than a predetermined value. 

8. An image processing q»paratus comprising: 

first calculation means for determining a weighted aver- 
age for each pixel by multiplication and addition of 
plural binary image data in the vicinity an object 
pixel and weighting coefficients of a predetermined 
distribution; 

input means for applying a predetermined image process- 
ing to the average calculated by said first calculation 
means, considering said average as a multi-level image 
value, and entering a multi-level value datum of said 
object pixel; 

second calculation means for determining the average 

density of a predetermined area; 
binary digitizing means for again binary-digitiztng the 

multi-level value datum of said object pixel, based on 

the average density obtained by said second calculation 

means; and 
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conectioD means for coinpensatiDg for the error generated 
in the binary digitization of the datum of said object 
pixel by said binary digitizing means. 

wherein said second calculation means determines (he 
' average density using binary data rebinarized by said ^ 
binary digitizing means. 

9. An image processing apparatus comprising: 
converter means for receiving data digitized with m levels 

(m^2) and convening the data into data of n levels 
(n>m); 

data processing means for ejiecuting data processing on 
the data of n levels produced by said converter means; 
and 

digitizing means for digitizing the data of n levels, data- 15 
processed by said data processing means, again into 
redigitized data of m levels. 

wherein said digitizing means digitizes the data of n levels 
produced by said data processing means into the redigi- 
tized data of m levels utilizing data already redigitized 20 
to m levels and an error generated in the digitization, 
and 

\^erein said digitizing means is ad^ted to determine an 
average density in a predetermined area, based on 
plural redigitized data from said digitizing means, and 25 
to digitize the data of n levels produced by said data 
processing means, utilizing the average density. 

10. An ^}paratus according to claim 9. wherein m=2 and 
wherein said converter means is adapted to receive binary 
data which has been subjected to binaiy digitization, and to ^ 
convert the binary data into the data of .n levels utilizing a 
weighting mask having a weighted distribution. 

11. An q>params according to claim 10. wherein said 
digitizing means Is adapted to binary-digitize the data of n 
levels produced by said data processing means. 

12. An apparatus according to claim 11, wherein said data 
processing means is adapted to apply a predetermined 



editing process to ttie data of n levels obtained by said 
converter means, and wherein said digitizing means is 
ad^ted to binary-digitize the data of n levels which has been 
subjected to said editing process by said data processing 
means. 

13. An image processing method comprising the steps of: 
receiving data digitized with m levels (m^2) and con- 
verting the data Into data of n levels (n>m); 

data processing the data of n levels produced in said 
receiving and converting step; and 

digitizing the data of n levels, data-processed in said data 
processing stq>. again into redigitized data of m levels. 

wherein, in said digitizing step, an average of a predeter- 
mined area is determined, utilizing data akeacty redigi- 
tized to m levels, and the data of n levels produced in 
said data processing step is converted into the redigi- 
tized data of m levels based on the average. 

14. An image processing metiiod comimsing the steps of: 
receiving data digitized with m levels (m^2) and con- 
verting the data into data of n levels (n>m); 

data i^ocessing the data of n levels produced in said 
receiving and converting step; and 

digitizing the data of n levels, data-processed in said data 
processing step, again into redigitized data of m levels. 

wherein, in said digitizing step, the data of n levels 
produced in said data processing step is digitized into 
the redigitized data of m levels utilizing data ah^dy 
redigitized to m levels and an error generated in the 
digitization, and 

wherein said digitizing step is adapted to determine an 
average density in a predetermined area, based on 
plural redigitized data from said digitizing step, and to 
digitize the data of n levels produced by said data 
processing step, utilizing the average density. 
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